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ABSTRACT ^ 

Related research suggests that* children may show some 
simple understanding of event covariations by the early elementary 
school years. The present experiments use a rule analysis methodology 
to investigate covariation judgments of children in this age range. 
In Experiment 1, children in second, thir^ and fourth grade judged 
^covariations on 12 different covariation problenns. Children's 
performance patterns on the problenj set showed an increase,Jn the use 
of systematic judgment strategies irf this age range. Systematic rule 
users most commonly compared contingency table cells "a" and "b" in 
judging the event covariations. In Experiment 2, a^ training paradigm 
fas employed to investigate possible origins of systematic rule use. 
^First and second grade unsystematic, strategy and cell-a children 
!i^ere either directed to attend to cells "a" andt *'b" (Attention only), 
were additionally offered explicit instructions to note which of the 
two cells had more even^ts (Attention-plus-more) or were given no 
training (control), .posttest performance showed that the 
Attention-plus-more condition was the only treatment to 'reliably 
elicit a-versus-b rule use. It is concluded that simple covariation 
judgment rules can be used by children in the early elementary school 
years. (Author) 



ED 238 708 

AUTHOR 
TITLE 

INSTITUTION 
SPOHS AGENCY 
PUB DATE 
CONTRACT 
NOTE 

PUB TYPE 

EDirSr PRICE 
DESCRIPTORS 



* ^***«**««**^**«^**********ifr*«r4b************ ****************** A irA**^** 

^ Reproductions supplied by EDRS are the best that can be made * 

* from the original document, * 



\ 



/ 



U S DEPARTMENT QF EDUCATION 

NATIQMAI IMSTITUTE OF EOUCATrOM 

£t>UCATlOfJAl fltSOUrtCtS IMf OHMATION 

Th*S cI&CyiTurtt ^ij^ t,i'i>'t rt^otfjtwl Hi 
^ /t(,CiVt'<l from 1h+ iiw^th.-t ,,\ i>f[)Jnif3tiOfi 

Or.^r>3ti^ it 

nirni ijij riM fU-* I'-^vs'-iy i t'O ' ^''^^^ f^t^'^ '^f'^fE 

w 

Eliciting Systematic Rule Use in Covariation Judgment [in Early Years] 

Harriet Shaklee and Donald Passek 
University of Iowa 



Running head: Covariation Judgment 



Partial support for this research was provided by NIE grant NIE"G^80-0091 * 
M£.ay thanks to Ernest Jones. Renee Smith, Rick Taffe and Janet Lyness for their 
help with data collection* Reprint requests should be sent to Harriet Shaklee, 
Department of Psychol*^gy» Universityi of Iowa» Iowa City* Iowa 52242. 



Covariation Judgment. 
1 

Abstract 

Related research suggests that children may show some simple understanding of 
event covariations by the early elemeritary school years, Th^ present experiments 
use a rule analysis methodology co investigate covariation judgments of children 
in this age range. In Experiment 1, ch^j-ldren in second, third and fourth 
grade Judged covariations on 12 different covariation problems. Children's 
performance patterns on the problem set showed an increase- in the use of 
systematic judgment strategies in this age range. Systematic rule users most 
commonly compared cont^^ency table cells a and b in Judging the event covariations. 
In Experiment 2, a training paradigm was employed to investigate possible 
origins of systematic rule use. First and second grade unsystemati?, strategy 
0 and cell-a children wfere either directed to attend to cells and b (Attention 
only), were additionally offered explicit instructions to note which of the 
two cells had more events (Attention-plus^ore) or were given no tiraining 
(contrql) < Post test^ perf ormaifce showed that the Attention-*f>lus-more condition 
was th^ only treatment to reliably elicit a-versus-b rule use* It is concluded 
that simple covariation judgment rules can be used by children in the early 
elementary school years* 
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Covariation JuHgment 

Covariation Judgment; Systematic Rule Use in the fiarly Years 
Interest in children's causal r^soning has burgeoned in recent years 
(e.g,, Siegler, 1976; Bullock, Gelman ^ Baillargean, 1982), A number of 
theorists have suggested that identification of cause-effect relationships is 
grounded in covariation judgment^ (e»g,, Inhelder ^ Piaget. 1958; Kelley, 1972)» 
That is, people search for causes of events by finding event covariates* In 
fact, a few investigations indicate that children understand this link from an 
early age- For example* DiVitto and McArthur (1978) found that children as 

V 

young as first grade use suijsmarized covariation information in explaining people* 

behavior- Siegler and Liebert (i975), however, found that children were not 

influenced by event covariation until 8 or 9 ye^rs of age in their study of 

children's explanations of Physical events. Evidence of the earliest use of 

event covariation in causal reasoning is provided by Shultz and Mendelson (1975), 

who found that 3 and A year old children showed a preference for covariates 

when choosing causes of events. Although the age trends differ in these studies, 

they concur in suggesting that preference for consistent covariates is an early 

developing' pattern in children's explanations of events, 
, 

Given this evidence, understanding development in covariation judgment 
would be critical to understanding children *s causal reasoning. However, 
investigations of children's abilities to make covariation judgments are rare 
indeed. Those few studies which do exist show a degree of consensus on how 
children might judge event relationships (Inhelder^ Piaget, 1958; Adi, Karplus, 
Lawson & Pulos, 1978; Shaklee fit Mlms, 1981), In the basic paradigm investigators 
offered subjetits information op the frequency of cooccurrence of alternative 
event states of two potentially related variables (for example, plants healthy 
or not healthy; plant food present or cbsent^ Subjects vere a^ked Identify 
the direction and/or strength of the relationsnip between the events. In each 
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experiment, subjects* covajriation judgments and/or explanations of those ^ 
judgments led the investigators to identify systematic but inaccurate rules 
which were precursors tq^ the use of iDore niathematicall3f%ophistlcated rules, 
Inhelder and Fiagec (1958) proposed two simple rules of covariation 

Judgment, In the first, an individual would judge a relationship according to 

< 

the frequency with which target event states cooccur (e»g. , healthy plants 
which are given plant food in the example above, cell a_ of a traditionally 
labeled contingency table. See Table 1)- A subject using this strategy would 



Inseirt Table 1 here 



identify a positive relationship between events if the cell a^ frequency were 
the largest of the contingency table cells, and a negati\e relationship if it 
were the smallest (cell-a strategy) » Inhelder and Piaget (1958) identified 
this strategy as common among younger adolescents* Smedslund (1963) ^d 
Nisbett and Ross (1980) thought the strategy might typify adult reasoning as well, 

Also proposed by Inhelder and Fiaget (1958) was a second simple approach 
comparing the number of times the target outcome occurs with the suppbsed^^ 
cause (or covariate) with the number of times it occurs without that cause 
(for example, healthy plants with pl^nt food vs, healthy plants witiS*>ut plane 
food). This would compare contingency table cells a^ and b (strategy a-versus-b) - 
This strategy was identified by Inhelder and Piaget (1958) as typical of 
young adolescents and was found by other investigators to be coimnon among high 
school subjects as well (Adi, Karplus, I^awson and Pulos, 1978)» 
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Inhelder at^d Piaget (1958) proposed a third strat£>gy as characteristic 
of formal operational thinking* That is, subjects would compare frequencies 
of events confirming (cells £ and d) and disconf inning (cells b^ and c) a 
relationship a particular direction* This rule wopld compare the sums of 
diagonal ceils in- the contingency table (sum of diagonals strategy), , 

Finally, Jenkins and Ward (1965) propose $hat covariation is mqst accurately 
asse^ised by comparing the conditional probabilities of an event occurring 
givan each of the alternative states of the other variable (e»g», plant healthVplan 

food vs» p'lant health/no plant food)* This would compare the frequency ratio 

* a ^ b 

in. contingency table cells ~ w'f th that in cells — z: — (conditional probability 

a^ + ^ b^ + jd 

strategy) » i " 

^^^^ 

This analysis of possible rules may allow diagnosis pf strategies actually 
employed by children <jf various ages. That is, different rules should produce 
differ^kt judgments on carefully constructed covariation problems, A set of 

i 

such pi^oblems is illustrated in Tables 2a and 2b- Solut-icn accuracy is indexed 

Insert Tables 2a and 2b here 

by the direction of the Judged relationship (i»e» A^^ more likely given Bp 
^01 no difference). Problems are structured hierarchically such that cell-a 
problems are correctly solved by ail strategies, a-versus-^b problenis are 
accurately solved by ail strategies except cell-a, Sum~of -diagonals problems 
ari; accurately judged by sum-of-diagonals and conditional probability strategies 
and conditional probability problems are accurately judged by the conditional 
probability rule alone (see Table 3) • The probability of matching these 
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Insert Table 3" here 



judgment patterns by chance alone is ,11 for cell-a, ,04 for a-versus-*b, ,01 
for sum of diagonals, and ,005 for the conditional probability pattern. 

Shaklee and M-^ms (1981) used this rule diagnostic approach to study 
covariation Judgment strategies used by">gubjects from 4th graite^ through colleg 
age. Subjects* judgment patterns in t^fat age span snowed a Strong deVelopjaentalV 



trendf with the a-versus-b strategy evidenc^ by substantial numbers of subjects 
beginning in the fourth grade* (29%), and sum of diagonals the modal strategy at 
7th and 10th grade (50% of subjects). Conditional probability patterns were 
produj:ed by ^many subjects at the 10th grade (27 %) bij^ were still used J)y a 
minority of subjects even in the college years (38%), Thus, this evidence 
supports previous -""nvestigators* suggestions that children may use simpler, 
less accurate rules as precursors to mature reasoning. However, these results 
deviated from previous conclusions in two notable ^ays. First, the commonly 
proposed cell~a judgment pattern was rare among subjects at any of the ag^s 
tested (0-*8%), In addition, the levtl of mature reasoning most often fell short 
of the opTjimal judgment sti:ategy. 

These results further contrast uitii^£Uid^^Q in the causal reasoning 
research where use of covariation information was saen in causal Judgment 
anywhere from presohool to 8-9 years of age, Shaklee and Mims (1981), on 
the other hand, find that nearly half of fourth graders showed no systematic 
bases of covariation judgment, A look at the causal reasoning research indicates 
that these studies offered children a relatively easy task ot covariation judgment. 
DiVitto and McArthur (1978), for example, summarized the covariation *i:forraation 
for the subjects, allowing children to u^e the information in causal judgment 
when' they might ,not be able to derive that information for themselves • 
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In the remaining studies (Shultz d Mendelson, 1975; Siegler d Liebert, 1975), 
the target event and its possible causes were either perfcictly contfngent 
or completely independent. Studies of covariation judgnent, on the other hand, 
cominonly^ask for jud£.ments about ier^s-^han-perf e«:t relationships. This analysis 
would indicate that young children may evidence ^ very simple understanding of 
covariation which does not hold up well when judging relationships of intermediate 



stJ£^ngth, 



A final relat^ paradigm must also^e considered in understanding children's 
covariation judgment* fhat is, one common ly<;\ employed test of probability 
judgment is one in whi^h a child is shown two v^^^^^ marbles composed of 
different proportions of marbles of two colors. The subject is ask^d to 
indicate the pile from whi<^ he or she would rather make a blind choice in ' 
order to obtain the marble of a particular color* The judgment is formally 
comparable to a covariation judgment, where a subject decides if a given outcome 
is more likely under condition or Sieglpr's (1981) rule analysis of 

children's performance in this paradigm shows systematic rule use by a narrow , 
majority of 5 year olds with most of those children usi^g a rule comparable to 
the a-versus-b rule in covariation judgment research. By 8-9 years of age 
a substantias* majority of children were using systematic judgment rules, 
with a comparison of condltiop^i probabilities the modal response pattern in 
Experiment 1, a-versus--b the dominantly used rule in Experiment 2, Each 
experiment found a comparison of conditional probabilities ttf be the most 
common ruie among 12 year olds and adults* 

* Thus, in contrast to covariation judgment research, Siegler found that systematic 
rule use in a related judgment occurs at an earlier age, culminatijig in use of the 
optimal rule by early adolescence, Siegler's (1981) findings may suggest that Shaklee 
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and Mims (-1981) ■ provide a conservative estimate of children's acquisition of 
systematic bases of covariation judgment. Causal reasoning research also 
indicates Tfe^at some simple understanding of event covariation may be seen by 
the early elementary school years* Possible resolution of therse differences 
may begin'with a careful look at the covariation judgment paradigm. The reliable 
strategy ,use evidenced by older subjects clearly indicates that they .understood 
the experimental stimuli and'procedures, l3owever> among the fourth grade 
sample, 25% of the subjects produced unclassif iable response patterns > and 
an additional 217^ passe<^ no strategy criteria at all* This high rate of 
unsystematic responses may indicate that a substantial group of these children 
were confused by the paradigm and thus, unable to demonstrate systematic rules 
which may 'be in their repertoires* If this wer^^ the case, a simplified approach 
should be developed to test these younger subjects, 
^ We address the question of early covariation judgment in two ways, ^ 

Experiment 1 employs a simplified paradigm to examine the development of 
covariation judgment rule>use among young elementary school children. Once , 
these normative trends are established our second study investigates sources of this 

I 

shift to systematic rule use. In Experiment 2^ we test information components which 
may be sufficient to elicit reliable rule use among young children, 

^ Experiment ■! '/ 

^ / 

Simplification of our previous experimental procedure was accomplished in 

" * 

two major vays. Firsts we were cOncerneJ that younger subjects might not 
undeqrstan4 the stimuli represented in the 2x2 table. As a result > a new ^ 
introduction e::fpanded the discussion of the contents of the ta^le^ asking the 
Subject to potnt to examples of each of the fovr possible combinations cf ^ 
event states in the table* 

Secondly, we suspected ,t;hat our previous question format might be overly 

\ ^ * ' 

complex for the younger children. The pV^^vious question asked (in the plant 

^ food example discussed above) , ^ 

ERJC - Q 
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When theji got special food, plantG were 
a) more likely to be healthy than 
*b) just as likely to be healthy as 
c)^ less likely to be healthy than 

when the:^ didn't get special food, 

A reformulated question offered simpler syntax: 

H 

Plants were more likely to get better if 



a) they got the special food 

b) they did not get the special food 

\ . 

c) no difference ^ 

We expected that thi^ simplified question would be more appropriate / 
to the language competencies of younger subjects. Experiment 1 also included 
two different problem, sets in anticifation of our needs in the subsequent study; 

i ithod I 

Subjects . ' ^ ' 

■ \ 

Subjacts xrf the .experiment were respondei^ts to an advertisemegjt in a Small 
town newspaper offeri^ ^^ayment to second, third aad fourth grade children for 
participating in a psychology experiment* The resilltant sample included 37 second 
graders, 18 third graders, and-17 fourth graders. 
Problems * ' » 



E 



Subjects judged one of txio sets of 12 covariation problems, each structured to ; ^ 
produce a distinctive pat^|;ern of solution accuracy by each of the'four proposed judgment ' . 

7 ■ - 

rules. In ^ne set of problems, cell ^equencies, totaled 36 for each problem (set 24), 
in the other set, cell freqii^ficies totaled 36 for eacSi problem (set^SS)- Except for i 
thes^ frequency differences; the two problem sets were ^dentical in other respects- 
Tables 2a and 2b show the actual problem frequencies used for the problems in each of 
the two sets. The 12 problems in each set included thre^e problems for each of the four 
strategy types. One noncontingent (middle row Tables 2a and 2b) and ^rttingent 
relationships (top and bottom rows Xlblev^a^^^^d 2b, P(Aj/Bj) *^ P(Aj/B2) = (*40 to ,50)' 

ERIC , . * 10 
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were included for each problem Atrategy^ type. Table 3 shows the pattern of solution 
accuracy congruent with each of the proposed rules, 

>/ Each problem was set in a concrete context of two everyday evsnts which 

/4/ ■ . ^ * 

may or ^y not fee re^lat^d* Each individual event pairing was illustrated with 

a small .picture showing the state of the two variables (e,g,, plant sick or 

* healthy/plant food prest^nt oc absent)** Three problems pi^itured bakery product*s 

which eithet rose or fell in association with the^/presence ol" absence of 

yeast, baking powder,, or a "special An^edient*', In three other problems, 

plants were pictured as hehlthy or sick as a possible function of the presence 

or absence of plant food, bug spray, or a "special medicine**. In three piroblems 

t - 

t ptfople or anVmals wers pictured as. sick or healthy as a possible , ^ 

function ftf^ the presence or absence of a shot, liquid medicine, or a pill^ The 

\ 

three remaining problems pictured a possible assoc>.atioii between space 
creatures appearing happy or sad in the presence or absence of oiie of three 
lifeatjier conditions (sAow, fog, or sunshine). 

For each problem, data instances were organized* in a 2 x 2 table. In 
each case, the manipulated factor (or enviroraa^ntal'.event) defined the table 
CO4 imns (e.g., plant food, no plant food in example below), and the outcomes 
dfefined the table rows (e»g,, plants healthy, no\ hea ltliv in the example 
below). Each problem tJas introduced with a paragraph describing a context in 
which several observations \^ere made on two potentj^ally related variables, 

r ' 

Subjects were, asked to^look at the piotured Itiformation and to identify the 
relative likelihood of one of^hsr events when the second event was either 
presen^t t>r absent. An example problem follows: 
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A plant grower had a bungh of s*ck plants. He gave some of them special 
plane food> buc some plants didrf't get special food* Some of the plants 
got better but some of *)them didn't* In the picture you will see how many 
^ times these things happened together. The picture shows That the plants 
/ w^r^ more likely to^get better if; 

A, thejr got the special food, 

B, they did not get the special food* 

C, no difference (they were Just as likely cp get better with food 
as without^ the food). 

The 12 problems were grouped into problem blocks^ including one problem 
from each strategy type. Problems within each block yere arranged in a single 
random sequence. The tht;ee problem blocks were sequenced in a single random 
order. Numbers in parentheses to the left of the problems in Tables 2a and 2b 
indicate the position of each problem in the problem sequence. 
Procedure 

Each subject was tested individually. Introductory instructions introduced 
the subject to the concept of covariation in the context of **things that go 
togethdS:", Naturally occurring examples were given of positive relationships 
(i.e*, tall people are more likely to be heavy than short people) > n^egative 
relationships (i,e*> it is less likely to rain when it is si^nny th^n when it 
is^cloudy), and unrelated events (i*e, , a green truck is just; as likely to run 
out of gas as a red truck). Subjects were told that they would be given som« 
problems about hypothetical events that may or may not tend to go together* 
Tvo sample problems were used to clarify the information in the 2x2 table. 
The f Jr55t «;ample problem was read t i the subject, the Subject was told that 
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pictures in the cells showed the occurrence or nonoccurrence of the two events 
in the story. The experimenter then pointed out that each cell represented a 
different combination of the two p'ossible events and stated what these were. 
The subject was asked to point to cells corresponding to specific combinations 
of events given by the experimenter. The experimenter explained that each 
picture in the cells represented one occurrence oi" a particular combination 
of events* so that the number of pictures in each cell represented the number 
of times that combination occurred. The experimenter then read the covariation 
question to the subject and asked him or her to answer it based on the events 
pictured in the table* It was emphasized that subjects should answer the 
queitions based on what had occurred in each story problem and should avoid 
basing answers on knowledge of common everyday occurrences (for example > 
that it is more likely to snow when it is cold, regardless of cell frequencies). 
Each subject gave a solution to the problem and repeated the proc^edure on 
the second sample problem, Si^bjects were encouraged to ask any questions 
they might have about the task. 

The subject then proceeded to the 12 problem set. Each of the problems 
ia the set ^ere read to the subject by the experimenter. Subjects were allowed 
-to answer the problems at their own pace, 

. * Results 

Our main interest in thi^ study was to establish trends in^ strategy 
use among these younger subjects* As a Lasult> the analyses in this study use 
subject strategy classif icatioa as the dspendent variable of interest. 
Subjects were classified for strategy use according to the method illustrated 
in Table 3* A subject was said to have "passed*' a given problem type if he or 
she was accurate on two or more of the three problems of a given problem type* 
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A subject vho met this criterion on all problem types would be classified as 
a conditional probability rule user> subjects who passed criteria on all types 
except the conditional probability problems were labeled sum-of -diagonals 
judges, A-versus-b judges should pass the cell-a and a~versus-b problems, 
but not the other problem types* cell-a rule users should pass criterion on 
cell-a problems alone. Subjects who passed no problem types were labeled 
Strategy 0; all other judgment patterns were categorized as unclassif iable. 
Table 4 shows the rule classifications of subjects in each ot the three grades. 



Insert Table 4 here 



The modal classification at each of the grades was a-versus-b> with very few * 
Subjects showing evidence of use of more sophisticated rules and a few subjects 
at each grade with cell-*a rule judgment patterns. Many subjects in the second 
and third grades made judgments that were not classifiable by any of our rules. 
Effects of grade level and problem set were examined by assigning subjects a 
score according to the number of problem type criteria passed, Thus> Strategy 
0 subjects were assigned a score of 0> conditional probability subjects a 
score of 4, Unclassif iable subjects could not be clearly ranked in this way 
and were excluded from these analyses* Data from the remaining subjects were 
analyzed in an analysis of variance with subject'a grade (2> 3> or 4) and 
problem set (24 or 36) as factors* These analyses showed a significant effect 
of grade* £ (2>51) = 3*30> p < .05^ with third and fourth graders similar to 
each other* and classified as using more advanced rules than the 2nd graders 
(Duncan's multiple range test, p < ,05), Problem set effects were not significant. 
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Discussion 

Related research in causal reasoning and probability judgment indicated that 
children might show some simple understanding of event covariation by early elementary 
school. This experiment found that a majority of ^ildren do show systematic rule use 
in covariation judgment by the secon^ grade. Significant age trends also show an 
increase in systematic rule use with age in the second to fourth grade age span. Rule 
categorizations in this age range show a substantial decline in unclassif iable and 
Strategy 0 subjects with increasing age and an inc""ease in a-versus-b rule use. 
However, use of more advanced 'rules was rare at all ages tested. 

Comparison with Shaklee and Mims (1981) indicates that subjects did indeed 
show earlier competencies with our revised procedure* Kearly all fourth graders 
were classifiable by one of our proposed rules in the present experiment and 
a majority of children showed systematic rule use in the second and third grades. 
Overwhelmingly, these children were classified as using the a-versus-b rule. The 
low frequency of more sophisticated strategies is comparable to that seen in 
our prior research. Also, similar to o^^r past results is the low rate of 
usage of th^ cell-a strategy. This is especially interesting, gijf^ that it is 
the most common of th^ proposed judgment strategies and was even said to be 
the modal strategy among adults (Smedslund, 1963; Nisbett S Ross, 1981), 
Our evidence finds this strategy to be rare among children as young as second grade* 

These results would indicate that our prior procedures may have been 
unnecessarily confusing to younger subjects. Our prior and present procedures 
were not systematically compared in this paradigm^ nor did tfte compare aspects 
of the changed procedure (e.g,, instruction vs, question format) in a factorial 
design^ As a result, we can offer little information about what aspects of 
the prior procedure may have been a problem* However, it i3 clear that we 
have developed a procedure suitable for use with young children. These findings 
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indlcace that children as young as second grade use simple but systematic rules 
in judging event relationships. 

Age crends in this paradigm show origins of rule use in covariation 
judgment at age levels comparable to that of researchers in causal and probabilistic 
reasoning, However> in one respect> these results differ from Siegler*s 
(1981) data on children's probability judgments* In those experlments> substantial 
numbers of children used the conditional probability rule by 8-9 years. In 
fact, a comparison of conditional probabilities was the modal response pattern in this 
age group in ono of his experiments* In contrast, none of the subjects in 
this experiment was classified as using the conditional probability rule and onl^y a 
few used the sum of diagonals rule* Our past research (Shaklee & Tucker > 
1979; Shaklee & Mims, 1982\ found tne conditional probability rule to be used 
by only a minority of subjects even at adulthood* Thus> comparability between 
these paradigms in terms of early rule use is not matched by performance 
siuilarity in Ihe later years. Expressing a judgment in terms of marbles in 
piles elicits more advanced rule use than a question asking for a comparable 
decision in terms rif covariations between potentially related events* One 
difference may be that oui" problems are set in conte5;ts cf events that are 
readily interpreted as causally related, Adi and colleagues (1978) found that 
subjects used simpler, less accurate rules in evaluating cause^effect relationships 
than ifL making covariation judgments on analogous problems* Eviden^ie such 
as this may indicate that covariation judgment in a causal context lags behind 
the same judgmeni, a^Jut non-causal relationships. / 

Our evidence of systematic rule use at an early age is intriguing^ but 
equivalently interesting are the unsystematic judgments of so many age peers. 
That Is, at second and third grades a majority of children are classified by 
one of our rules (59% and 61% respectively), but s substantial minority in 
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each grade produce unsystematic judgment patterns (19% and 39!£ respectively) 
W pass no problem type criteria (Strategy 0 = 22% of second graders). 
Inspection of Individual subjects' judgment patterns failed to identify any aJternative 
strategic bases of these responses* Thus some children are uftsystemaCic in 
rule use at rhe same age as other children begin to show use of simple 
Judgment strategies* What did chese rule users know that allowed them to judge 
the problems in a systematic fashion? Several factors may differentiate these 
rule users from their unsysteiaatic age peers* 

One possibility may be that unsystematic subjects are not using the rrbled 
frequencies at all, but rather are judging the event covariations on the basis 
of their prior expectations about the event relationships* For example, such 
children may decide that plants are more likely to be healthy when they get 
plant food based on tlj^ir real world experience, regardless of the event 
frequencies in the problems they are asked to judge* Our instructions already 
caution subjects against making expectancy-based judgments but those instructions 
may be readily forgotten as the subject solves the problems* 

Expectancy-Abased judgments may be a source of unclasslfiable response 
patterns, but what leads others of these young subjects to adopt an a-versus-b rule? 
We suspected that the judgment question itself may direct children's attention 
to cells a and b of the contingency table. Asked if plants are more likely to 
be healthy when they get plant food or when they do not get plant food, '^a 

*r 

subject may look at these two eveat conjunctions (i*e*, healthy plants-plant tood, 

healthy plants-no pJant food)* A subjects must also attend to the comparative 

aspect of the question in order to employ the a-versus-b rule* Mastery of either 

the attention direction or comparative aspects of the judgment (or both) may be 

key competencies underlying the shift to a^ersus-b rule use the^e early 
ages. 
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These are plausible sources of development in covariation judgmenc, but 
Laeir roles in the origins of systematic rule use have yet to be demonstrated. 
An approach often employed to model a naturally occurring de /elopmental trend 
is a training paradigm- That is, one might identify a training program which 
teaches non-rule users the knowledge said to differentiate those subjects from 
rule-based age peers. Contents of a successful training procedure identify at 
least one sufficient model to account for Uie natural transition to systematic 
rule use. 

Experiment 2 

We propose to use this training strategy in Experiment 2 to investigate the 
origins of systeiftatic rule use in judging event covariation. Results of 
Experiment 1 indica^ted that reliable rule use was already becoming common in the 
second grade sample. Thus, Experiment 2 was an attempt to train first and second 
grade children to use the a-versus-'b rule. We chose not to train children In use 
of the cell-a rule since it so rarely occurred naturally* 

If young children's Judgments are un^ystet .-^tic because they are expectation-based* 
this problem would best be treated by drawing children's attention to the 
frequency information i*i the tables. Thus, one training procedure directed \ 
children's attention to the frequencies involved in the a*^versus-b rule, i.e., 
cells a and b- This was the reasoning behind the Attention-only condition, where, 
on a set of 6 training problems, the experimenter asked the subject tp point 
to the event combinations ^specifically mentioned in the question and to count 
the number of cases in each of the two cells. Subjects then made their covariation 
judgment * 

As suggested previously, a subject may also fail to use the a^versus-b 
rule because he or she misses the coniparative aspect of the question i.e,, which is 
more likely, A second group of subjects, were given the Attention instructions on 
the training pr^lems and, in addition, were specifically asked which of the two 
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c^lls had more cases in it, Subjects then made their covariation judgments. This 
group is the Attention-plus-m'ore training group, 

A final group is a no-training control group> who judged the same 6 
problems but were given no special instructions. 

All subjects were pretested to establish initial rule use^. Unclassif iable , 
Strategy 0 and cell-a judges were included in the paradigm. Subjects were 
- randomly assigned to one of the three conditions. Training effects were measured 
in a posttest given about a week after the training session. In view of their 
comparability in Experiment 1> problem set 24 and set 36 were problems in this 
experiment: - 

Method 

Subjects ^ 

Subjects, w^e respondents to ads in a small town newspaper offering first 
and second grader^\payment for participation in a psychology experiment. Forty- 
nine subjects participated in the pretest session of the experiment. However, 
13 subjects were dropped from the experiment because their pretest strategy 
indicated that they were already using the a-versus-b (9 subjects;) or a more 
advanced strategy (3 sum-of-diagonals subjects, 1 cond^-tional-probafcility 
subject). The remaining 36 subjects (18 males and 18 females) included 13 
unclassif iable, 17 Strategy 0, and 6 cell-a subjects, ^tean age of these 
subjects was 7 years-6 months (range 6 years-10 months to 8 years-0 months). 
Pretest 

Problems and instructions on the pretest were identical to those described 
in Experiment K Half of the subjects were given problem set 24 for the 
pretest and set 36 for posttest, the remaining subjects were given the problem 
sets in the reverse sequence. 

Once the problem set was completed, the experimenter determined the 
subject's judgment strategy in the manner described in Experiment 1, 
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Training 

Six problems were developed for training. These problems used cell 
frequencies and contents whicK were different from chose used in the two test 
sets. Subjects classified as cell-^a. Strategy 0, or unclassif iable were 
randomly assigned to one of three training conditions (12 subjects per condition)*^ 

Attention-Only ^ This training was designed to dTrect subject's attention 
to che^two event pairings specifically mentioned in the^question (i-e, > cells 
a and b) , Verbatim instructions ^ox this condition were as follows (portions 
were re-phrased if necessary): 

In doing these problems, **you may have had a certain way of deciding which 
answer you thought was right. For example, you may have thought that 
certain boxes and the pictures in ihem were important and other boxes 
were not i^ortant in answt ring the question, Or you majr have compared 
certain boxes with each other. If one thing happened more than another 
thing, it may have been more likely to happen* How we are going to see 
if there might be another way to solve these problems that may be better 
than the Tfc^ay ^ou used. We wilJ try to decide which boxes and the pictures 
in them are important in deciding ^hich answer is right, I want you to 
think hard now about a good way to answer these problems* 1*11 ask you 
some questions to help figure oi^t a way to decide what answer is right. 
(The first problem and question were read to th^ child.) 
If we wanted to decide which answer is light, it is important to look at 
each answer and find good examples or pictures that may show that thing 
happening. For example* let us suppose we wanted to see if answer A 
might be the right answer. Answer A says (e,g.» the bugs are more likely 
to craw*! an the leaves when it is sunny out). Could you show me vhich 
box or pictures are good examples of that?* Which pictures show where the 
(bugs crawl on the leaves when it is sunny out)? 
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(Subjects should point to cell and were corrected if did not. 

When subjects did point to cell a:) ^^ 

Right, Can you teil me why? So these pictures show the (bug^ crawling 
on Che leaves when it is sunny out). This is an important box to look at 
in deciding if answer A is righr. And how many times did that happen? 
So there are good examples of answer A, 

(The experimenter also pointed to other cells > asked or pointed out why 
they were not good examples,) 

Now let us look at answer B, because that could also be the rfght answer, 
(The same procedure was repeated. Subjects should point to ceil b^* The 
exp'eriraenter selected answer A and answer B to be discussed first with 
approximately equal frequencies. The discussion was then summarized.) 
Okay> so that means that if we wanted to see if (question with answer A 
is read) this box (cell a) and the pictures in it would be important to 
look at. And we' see that it happened times. If we wanted to see 

if (question with answer B is read) this box (cell h) and the pictures in 

it would be important to look at. And we see that this happened 

times. It is also possible that answer C is correct> that it didn't make 
any difference (if It was sunny or not^ the bui;s were"-just as likely to 
crawl on the leaves). 

The covariation judgment <juestion was then read Co the subject and he or 
she made a response. 

Attention-plus -more . This training condition was designed to emphasize 
the comparative aspect of the <juestion, i,e,, which outcome was more likely? The training 
builds on the Attention-only training described earlier. Subjects in this 'Condition 
heard all of the instructions in the At tentioa-only training> and were then 
asked to make a direct comparison of eel' and coll b frequencies ("Which of 
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these two things happened more?"), The experimenter then read the 
covariation judgment question^ to the subject and he or she made a response, 
' Control ■ Subjects in this condition judged the same problems as subjects 
in the other groups, but were offered no training instructions, 

In each training condition, the procedure described was repeated on the 
six training problems* Feedback (positive or negative) was not provided 
following the subject *s answers to the covariation judgment question. 
Fosttest 

Subject fatigue prevented an Immediate posttest of training effects. 

However, all subjects did return approximately one week later for a delayed 

posttest. This posttest was administered by a ^ec^nd experimenter Lho was 

blind to the training condition of the subject* The experimenter first 

reviewed th6 stimulus materials and problem format by presenting one of the 

sample problems used in session 1* Following this, the second problem set was 

administered in the same manner as in session 1- Subjects were tested^on 

the problem set (24 or 36) not judged in the pretest session. Following 

completion of the problem set, subjects were told the purpose of the experiment 

0 

and its potential relevance to everyday causal reasoning. 

Results 

The first indication of the relative success of the training methods 
was children's performance on the 6 training problems. Subjects responded in 
the manner predicted by the a-/ersus-^b rule on 43»1% of the problems in the 
control group, 72.2% of the problems in the Attention-only group, and ' 
97.2% ot" the problems in "the Attention-plus-more group. An overall analysis 
of variance indicates these differences to be reliable, F (2,33) = 18.81, 
p ^ .OOU Pairwise comparisons indicate that each training group is significantly 
different from each of the other group* (Duncan's multiple range test, p< 05). 
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Effects of the training procedure are most clearly assessed by comparison 
of the posttest performance of subjects in the training and control conditions, ^ 
These effects will be analyzed both in terms of the accuracy of subjects on 
the various problem types and in terms df their posttest strategy classifications. 

For each subject, posttest judgment ac&uracy was assessed in term^ of the 
percentage of correct Judgments for each of the 4 problem types. These data 
were analyzed in an analysis of variance including problem type (4 levels) and 
subject *s training contl/t^ion (3 levels) as factors. This* analysis indicated a significant: 
main effect of problem type, F (3,9i^ = 17*22, p < ,001, and a significant 
interaction between problem type and training condition, F (6,99) = 5,78, p < .001* 
As the mean£3 indicate in Table 5, Attention-plus-more subjects were ^ ' * 



Insert Table S here 



substantially more accurate on cell--a and a-versus-b problems than on sum of 
diagonals and conditional^ probability problems. Attention-only and control subjects* 
performance were similarly poor across problem types. The main effect of 
training condition was not significant. 

Pretest and posttest sti:ategy classifications were compared for each 
subject to note training effects* Judgment was said to have improved if -a 
subj<ict was classified as using the a-versus-^b, sum of diagonals, or conditional 
probability strategy at posttest. Table 6 indicates the frequencies of improvement 



Insert Table 6 here 



of subjects in each of the three training corditions*^ In all 

cases subjects who improved were categorized as using the a-^versus^^b strategy. 
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all shows these training effects to be significantly different 



betwee^ conditions (x^ = 11*02> df = 2, p < ,01), As indicated in the table, 
rates of improvement were at similarly low levels (25%) in the control and 
Attention-only conditions compared with substantial rates of iiaprovement' (83%) 
among' Attention-plus-more subjects, 

, Discussion 

These results offer clear evidence of the differential effectiveness of 
our various training conditions. First, spontaneous imprt)vement from test 
to retest was ^re among subjects in the control condition. This would 
Suggest Lhat these young subject's problems were not simply lack of familiarity 
with the problems* ; 

Improvement rates were equally low in the Attention-only condition. This 
null effect indicates that simply directing attention to cells a and b is not 
sufficient to elicit a-versus-b rule use among these children. The failure of 
^ Attentiow-only instructions may imply that subjects at this age already know 
how to find tHe cells mentioned in the question. If this were the case 
control and Attention-only subjects would be essentially equivalent in knowledge 
state at poattest. One would also expect that the Attention-only training would 
be sufficient to overcome any tendency to make expectation-based judgments. 
That is, children's attention^was repeatedly directed to the information in 
the table cells. Inftleed', the children's improved performance on the training 
problems suggests that the training was successful in elicicing frequency-based 
judgments. However, those effects were not maintained at the posttest one 
ijeek later. Of course, any null effect has at least one alternative interpretation, 
Th^t is> the AttentioR-only training condition may have simply been ineffective 
at teaching children the knowledge that should have been sufficient to elicit 
a-versus-b judgments , 
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However, the^ttention-plus*-more training did result in reliable improvemenC 
the posttest. This finding indicates chat the comparative aspect of the 
Judgment ma^^ be a key obstacle to naturaJ use of this simple rule by young 
subjects. Although they may know that two cells of the table are relevant, 
apparently subjects this young cannot spontaneously derive a way to combine 
that Information to make a single judgment. Our training in the '*inore^' rule 
apparently offers them that information. Since this training builds on the 

J 

information oifered in the Attention-only condition, this eff^t may hinge on 
the combined influence, of the attention direction and comparative aspects of 
the (Question, Unf oTtunataly a ''More-only'' condition is logically Impossible, 
One cannot talk about comparing cells without designating which cells are to be 
compared. The fact that these training effects held over a one week delay 
period indicates the reliability of knowledge the children acquired, 

Tinally, it is worth noting the specificity of our training effects. That 
is, ail ^^children who improved in strategy use showed use of* the a-versus-b 
strategy* This aspect of the results indicates that subjects were not simply 
learning to be system^ti^in Judgment bases, , Rather, they acquired one 
specific judgment rule^'^On this problem set, use of the a-versus-b rule did 
not lead to an overall improvement in Judgment accuracy. This is by design 
of the problem set* That is, a-verslis**b judges should be correct on cell-a 
and a-versus-b problems but incorrect on the sum of diagonals and conditional 
problems. Thus, the successful Attention-plus-more training actually results 
in worse performance of half of the problems compared to the other two conditions. 

These training effects offer one sufficient model of the natural process 
of acquiring the a-versus-b rule, "Jliat is, subjects whose attention was 
directed to cells a and b and who were instructed to compare the two cells 
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showed a-versus-b rule use- Thus> these two knowledge components may be thg 
source ofj children's natural shafts to a-versus-b rule use. Of course* a 
sufficient process is not always^ necessary .one. That is, children may 
spontaneously discover the rule through yet another sufficient process. 

These traitiing effects may also be appreciated in a broader context. 
That is, research in causal reasoning indicates that some simple understanding of 
event covariatTon may begin in early elementary school (Shultz & Mendelson 
1975; Siegler & Liebert* 1974), Siegler's (1981) work in probability judgment 
shows siniilar age trends in children's use of simple rules, in comparing 
probabilities* This evidence indicates that those competencies may be shown 
at an even earlier age with a brief training procedure* It may be interesting 
to see if these improvgments in covari^ition Judgment would influence children's 
causal reasoning as w^l» This may be a domain in which to test children's 
ability to ^ply statistical concepts appropriately to related judgnuants. 

Whether children- could learnJto use a more complex rule with appropriate 
training is a question for future research. However/ the level of math 
involved in our other rules may, preclude their use in early elementary school* 
The sum of diagonals rule requires a tomparison of two sums, the conditional 
probability rule compares two ratios. These advanced arl^thmetlc competencies 
are likely to be vutside of th^ capacity of such young children* 

/ 

Ini^overviewj these two studies offer new infot;;mation about covariation 
judgment in the early elementary school years. That is> many children 
spontaneously show use of the a-versus'-b rule as early as second grade* 
Children as young as first grade can be taught to use this simple rule*' if 
offered the relevant in£oroiation. This training evidence offers one sufficient 
model of the natural acquisition of a simple rule for judging relationships 
between events* . 
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Footnote 

^We had some difficulty defining a noncontingent relationship for the 
sum of diagonals problems. The problem we included (iftiddle problem^ column 
3> Tables 2a and ,3b) deviates slightly from independence (P(A]^/Ej^) - 
PCAj^/B^) = -.06> 24, -,03 set 36) by the conditional probability rule. 
As a result we scored responses as correct if subjects concluded that ^i^^i 
was either less likely or just as likely as A^/E2- The problem does discriminate 
appropriately between the other judgment rules* Cell-a and a-versus-b judges 
shoulci say that Aj/B^ is more lik^ than Aj/E2> sum of diagonal judges should 
say the two outcomes are equally likely* 



c 



Covariation Judgment^ 
28 



Tab3e 1 

Contingency Table Cell Labels 
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Table 2 

A) Cell frequencies used for problems in problem set 24 j 



Cell a 
Problems 



a. versus b^ 
Problems 



Sum of Diagonal 
Problems 



Conditional 
Probability 
Problems 



(11) 


^1 


^2 


(6) 






(2) 




h 


(8) 




^2 




11 


2 


^1 


7 


3 




2 


2 


•s 


2 


12 


A, 


4 


7 


A, 


2 


12 


A2 


2 


18 




0 


10 



(3) 


^1 


^2 


(9) 






(7) 




^2 


(12) 








6 






3 


3 




9 


7 




1 


5 


A2 


6 


\ 

H 


^2 


9 


9 


A2 


5 


3 


^2 


3 


15 


(5) 




^2 


(4) 






(10) 






(1) 






A 


2 


a ! 


^1 


4 


11 


^1 


8 


8 




12 


2 


A2 


7 


4 ; 


A2 


8 


1 


A2 


8' 


0 


^2 




0 



B) Cell frequencies used for problems in problem set 36. 



Conditional 

Cell a a versus b. Sum of Diagonal Probability 

Problems Problems Problems Problems 
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^2 


(6) 






(2) 






(8) 




^2 




16 




^1 


U 


2 


■ ^ 


4 


4 




3 


18 




6 


10 


*2 


7 


16 


^2 


4 


24 


^2 


0 


15 


(3) 


h 


^2 


"X 

(9) 






(7) 




^2 


(12) 


h 


h 




9 


'9 




5 


5 




12 


9 




2 


7 


^2 


9 






13 


13 


■ ^2 


9 


6 


A2 


6 


21 


(5) 




h 


(4) 


^1 




(10) 






(1) 


h 


^2 




3 


16 


^- 


6 


18 




11 


U 




~13 


3 


^2 


10 


7 


A2 


9 


3 


A2 


11 


3 


^2 


15 


0 
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Table 3 

Strategy Classification Criteria 



Strategy use and resultant patterns of problem accuracy, 
(+ = accurate, 0 = inaccurate) 

Problem Strategy Type 
Cell Sum of Conditional 

± ^ versus b Diagonals Probability 



Subject 

Strategy 

Type 



Conditional 
Probability 








+ 


Sum of 
Diagonals 








0 


a versus h 




+ 


0 


0 


Cell a 




0 


0 


0 


Strategy 0 


0 


0 


0 


0 
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Table 4 

Vxh lass Sum of (ouditiunal 

i f lablt' S trat t'gy 0 (U-J J -a ^- vtTsu-s-b D^aK'^Tlal^) I'ro^abi iity N 

^19 2J ' 16 40 J 0 37 

J ■ J9 0 11 44 .6 0 18 

4 6 0 18 71 6 0 17 
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Table 5 
Experiment 2 
Mean percent correct for each problem type 

Problem Type 



Training 
condition 


Cell-a 


a-versus-b 


Sum of Diagonals 


Conditional 
Probability 


All 


At tent Ion- plus-more 


83.3 


80.6 


8.3 


5.5 


44.4 


Attention- only 


55,4 


44.3 


27.8 


33.3 


40.2 


Control 


52,8 


38.8 


44.4 


24.8 


40.2 


Ail 


63.8 


54,6 


26.8 


21,2 


41.6 
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TabK' 6 

hftec-ts of a-versus-b traiiilnj; on potiLtest performancti 



Controi 

Attentiun 
Only 

Attent iou 
plus more 

Total 



Itnprovtid 

.3 
3 

10 
16 



Didn't 
Imp rove 

9 



20 



Total 
12 
12 

12 
36 
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